-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update of the abbreviations #206
Update of the abbreviations #206
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- Didn't we settle on negative predictive rate parity? Why the change back to negative predictive value? I think you might not have reset your development branch after merging your previous pull request.
- What happens when you use
metric = "eo"
inmodel_fairness()
. It should at least give a warning message or something that it is not possible. - Can you make sure that the unit tests work again.
- Change "dp" back to "pp" since the proportional parity is equivalent to the disparate impact. "dp" is demographic parity and is calculated as (TP + FP)
d1f04aa
to
520d38e
Compare
Unit tests still fail:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Check the unit tests
I think this still needs the error handing for metric="eo", right? |
Just implement a simple error message for when metric is "eo", we can handle the rest in JASP. Then undo all changes in stanmodels.R |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
See comment above
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are lots of changes in the model_fairness.R
file, but you only need to add an error message. Please make sure that the changes here are (or show up in the pull request as) minimal.
R/model_fairness.R
Outdated
if (metric != "dp") { | ||
if (metric == "eo") { | ||
stop("Error: 'Equalized Odds' (EO) requires simultaneous evaluation of 'True Positive Rate' (TPR) and 'False Positive Rate' (FPR). You must first select tprp, then fprp, and ensure both fairness measures conclude no discrimination for both privileged and unprivileged groups before concluding no discrimination according to EO.") | ||
} else { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Remove the else
here, you quit the analysis at this point anyway if metric = "eo"
No description provided.